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ABSTRACT 


Although  Qausslan  probability  densities  are  extremely  useful  in 
engineering  analyses,  they  ave  frequently  mia interpreted  in  thia  context. 
Thia  report  ia  specifically  deaigned  to  clarify  thia  aituation.  While  the 
material  preaented  may  be  well  known  among  atatieticiana,  the  engineering 
community  appears  to  require  such  exposition. 

The  report  begins  by  developing,  from  first  principles,  the  contours 
of  constant  probability  associated  with  n-dimensionai  normal  density 
functions.  Analytic  expreaaiona  are  then  derived  for  the  probability  that 
the  random  variables  under  study  will  be  contained  within  these  contours. 
The  results  obtained  are  fully  discussed  from  an  engineering  viewpoint. 
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Although  error  analyses  constitute  one  of  the  more  frequently 
encountered  types  of  engineering  problems,  the  topic  is  fraught  with  fallacies, 
misconceptions,  and  distortions.  One  basic  difficulty  occurs  in  attempting  to 
interpret  covariance  matrices.  While  the  usual  assumption  of  Gaussianness  is 
reasonable,  there  is  widespread  tendency  to  assign  erroneous  probability  con¬ 
fidence  levels  to  the  associated  error  ellipsoids.  For  example,  it  is  not  well- 
known  in  the  engineering  community  that  a  2 -sigma  ellipsoid  carries  a  diffe rent 
probability  confidence  level  than  a  2 -sigma  ellipse  or,  for  that  matter,  than  a 
2 -sigma  line  segment. 

In  this  report,  an  attempt  will  be  made  to  clarify  this  situation. 
Although  the  material  to  be  presented  is  supposedly  "well-known"  among  a 
miniscule  clique  of  theorists,  it  is  often  the  subject  of  much  debate  and  the 
cause  of  considerable  confusion  among  engineers.  For  this  reason,  the 
development  will  begin  with  a  tutorial  review  of  n-dimensional  Gaussian  prob¬ 
ability  densities  and  their  associated  contours  of  constant  probability  in  var¬ 
ious  coordinate  systems.  The  results  obtained  will  then  be  used  to  develop 
expressions  for  the  probability  associated  with  error  contours  in  arbitrary 
dimensional  spaces.  The  practical  engineering  aspects  of  the  theory  with 
an  example  will  be  considered  in  the  final  section. 

NOTATIONAL  CONVENTIONS 

1.  The  symbols  A,  C,  T,  A,  ,  and  J  represent  matrices. 

2.  The  unsubscripted  symbols  x,  y,  z  are  column  vectors. 

3.  The  asterisk  (  )  is  used  to  indicate  matrix  transposition. 

4.  The  symbol  £  denotes  statistical  expectation. 

5.  All  other  symbols  represent  scalar  quantities. 
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GAUSSIAN  DENSITY  FUNCTIONS  AND  PROBABILITY  CONTOURS 

Let  x  be  an  n -dimensional  Gaussian  random  vector  with  mean  x  and 
covariance  matrix  C  given  by 

x  -  &(x) 

_*  (1) 
C  =  &(x  -  x)(x  -  x) 

In  general,  C  is  positive  semidefinite.  However,  since  the  case  of  singular 
C  is  of  no  practical  interest,  it  will  be  assumed  that  C  is  strictly  positive 
definite. 

The  probability  density  function  for  x  is 


PXM 


1 

(2n)n^(Det  C  ) 


tl  —  *  _1 

(x  -x)  C  (x  -x)J 


(2) 


It  follows  from  the  above  that  contours  of  constant  probability  density  are 
defined  by 

(x  -  x  )  ^C  (x  -  x  )  =  (3 ) 


for  arbitrary  constant  k.  Geometrically,  Equation  (3)  describes  hyperellip¬ 
soids  in  n-space. 


Now,  it  is  desirable  to  define  a  space  in  which  the  coordinate  axes  are 
coincident  with  the  principal  axes  of  Equation  (3).  Toward  this  end,  define 
a  new  n-dimensional  zero  mean  random  vector  y  by 


y  =  A(x  -  x) 

Since  C  is  symmetric,  A  can  be  chosen  so  that 


A*  =  A'1 
Det  A  -  1 

£(yy  )  -  A  =  ACA 


(5) 
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with 


The  elements  of  A  are,  of  course,  the  eigenvalues  of  C,  and  the  columns  of  A 
are  the  eigenvectors  of  C.  Thus  A  is  an  orthogonal  matrix  which  trans¬ 
forms  the  covariance  C  into  a  covariance  A  associated  with  the  principal  axes 
of  the  hyperellipsoid  given  by  Equation  (3). 


In  general,  if  random  vectors  x  and  y  are  related  by  a  one-to-one 
(nonsingular)  mapping,  the  associated  density  functions  are  related  by(Ref.  1) 


Py(y)  =  Px(x)  Det 


[4 


where 
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For  the  case  at  hand,  the  mapping  in  question  is  defined  by  Equation  (4),  so 
that  application  of  Equations  (2)  and  (5)  to  Equation  (7)  yields 


-1 


P  (y)  =  - -j2 - 

y  (2tt)  '  (Det  C) 


Det  A  ,1  *  -i  . 

rn  exP  (7  y  a  y> 


(2n)n^(Det  A) 


1  /  1  *A-i  V 

m  exp  (*  ry  A  y) 


(9) 


where  the  last  result  follows  from  Equations  (5).  Finally,  from 
Equation  (6) 


1 


,’y(y)  =  7r^7T  „ 

1  (2n)  0.0 


exp 


1  2 


n 


2  2 

1  /yl  ,  y2 

1  2 


+  j  + 


2 
yn 

o 

n/ J 


(10) 


It  follows  from  Equation  (10)  that  contours  of  constant  probability  density 
in  y -space  are  the  hyperellipsoids  given  by 


2  2 
yl  A  y2 
T  +  T 
°1  °2 


2 

yn 

n 


=  k‘ 


(ID 


These  contours  are  identical  to  those  defined  by  Equation  (3).  However, 
the  principal  axes  are  now  coincident  with  the  y -coordinate  axes  as  desired, 
i.e.  ,  yj(  y^  ,  yn  are  independently  distributed. 

For  ease  of  manipulation,  it  is  convenient  to  further  transform  the  y 
variables  to  a  space  in  which  the  constant  probability  contours  are  hyperspheres. 
In  line  with  this  goal,  define  the  new  random  vector  z  by 

z  -  Ty  (12) 


where 
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From  a  relationship  analogous  to  Equation  (7) 


which  reduces  to 


(14) 


(15) 


upon  application  of  Equations  (12)  and  (13).  Thus,  as  desired,  the  contours 
of  constant  probability  density  defined  by  Equation  (15) 

2,2,  2,2  .... 

Z1  +  Z1  +  +  zn  -  k  (16) 


are  hyperspheres  of  radius  k.  Comparison  of  Equation  (15)  with  the  general 
Gaussian  density  function,  Equation  (2),  shows  that  /  j .  ....  are 

independent  Gaussian  random  variables  with  zero  meat*  . > r . ci  unit  variances. 


From  the  basic  concept  of  density  functions,  the  p>  *  ability  ih.it 
Zj,  z ....  zn  lies  within  the  hypersphere  of  radius  k  is  «.  u  by 


-  5  - 


(17, 


From  the  preceding  analysts,  It  is  clear  tlat  p  (k)  is  also  the 
probability  that  \  lien  within  the  hyperelllpsold  of  Equation  (4).  Thu»,lh* 
basic  problem  of  finding  pft(k),  the  probability  confidence  level  ef  the  "k- 
sigma"  hyperellipsoid  in  n -space,  reduces  to  evaluation  of  Equation  (17). 

It  may  appear  that  the  most  direct  approach  to  obtain  the  dealred  prob¬ 
abilities  is  by  integration  of  (17)  using  n -dimensional  polar  coordinates. 
While  this  technique  readily  yields  the  desired  results  for  n  **  1,4*  and 
3,  the  integrals  become  extremely  unwieldy  for  higher  dimensions.  This 
difficulty  can  be  overcome  by  recasting  Equation  (IS)  In  terms  of  the 
chi-square  distribution  and  effectively  collapsing  n  dimens  ions  Into  one 
dimension.  Direct  integration  is  then  a  simple  task,  yielding  a  recursion 
formula  for  Pn(k)  valid  for  all  n  and  k. 

DETERMINATION  OF  PROBABILITIES  CORRESPONDING  TO  "k-SlQMA" 

CONTOURS. 

Define  the  random  variable  u  by  the  relation 

u  =  a?  +  *?+...+  (11 

i  c  n 

It  can  be  shown  [Ref  3]  that  the  probability  density  function  for  u,  p^(u),  la 
chi-square;  that  is 


P  (u) 
u 


T(n/2) 


u(n-2)/2exp(  u/2)  fQr  u>Q 


Pu(u) 


0  for  u<  0 


where  T(  )  denotes  the  Gumma  function. 

In  view'  of  Equations  (16)  and  (18)  the  interior  of  the  k -sigma  hyperellipsoid  in 
x-space  corresponds  to  the  line  segment 

7 

0  s  u  a  k1-  <201 


in  u-space.  Thus, 
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Pn00  -  "Trrr . 

n  ln'*r(n/l) 


a)/a**p  (.u/i)  tiu 


Specialising  Equation  (11)  for  n  »  1  «»\d  recalling  that  r(l/2)  -  ,-^n  yields 


P|0O 


exp(«  u/2) du 


* 

Performing  the  substitution  t  ■  u/2,  Equation  (12)  become* 

K/,7 

Pj(K)  «  **/  e*p(-  t4)dt^  erf(M  'I ) 
o 

For  n  *  2,  note  that  T(l)  »  l,  so  that  Equation  (21)  immediately  yield* 


P,(M  -  1/2 


n 


(l  .  ,  «k2/2 

du  -  1  *  e 


A  general  recursion  formula  for  all  n  can  be  established  by 
expressing  Equation  (21)  as 


^n,^lrin/4+D^ 


*oxp(-u/2)  du 


Then,  from  the  properties  of  the  Gamma  function, 


2fn/2Mn(n/.D+l 


n(n/.D+l)  *  n2n/2f(n/2) 


-  <  - 


and,  far  (militant  m  and  a, 


v,n«*p(av)dv 


rf 


vm’lexp(av)dv 


Thus,  Equation  (2$)  can  bo  rewritten 


n2(n-2)/2r(n/2) 


exp(«k*/2) 


Now,  the  first  term  on  the  right  aide  of  Equation  (28)  is  precisely  pR(k)  as 
Ui'iinotl  by  Equation  (21).  Thus,  Equation  (28)can  be  expressed  as  tho 
recursion  formula 

(29) 


Application  of  Equations  (23)  and  (24)  to  Equation  (29)  yields,  after  tome 
manipulation, 


^  These  results  were  obtained  by  L.  Schwartz  [  Ref.  5]  by  an  indirect  method. 
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A  graph  of  pft(k)  vs  k  for  atloctad  values  of  n,  ae  computed  from 
Equations  (30)  and  (31),  Is  presented  In  Figure  1.  These  same  results  are 
listed  in  tabular  form  in  Tables  1  through  8:  Tables  1  through  4  displaying 
values  of  k  corresponding  to  selected  pR(k)  and  n,  and  Tables  5  through  a 
displaying  values  of  pjk)  corresponding  to  selected  k  and  n. 


ENGINEERING  INTERPRETATIONS 

One  of  the  conventional  by-products  of  an  error  analysis  is  an 
n -dimensional  covariance  matrix.  However,  this  array,  though  frequently 
encountered,  is  often  misinterpreted.  It  should  be  clear  from  the  preceding 
discussion  that  this  matrix  is  related  to  the  one -sigma  hyperelltpeoid  in 
n-space.  Indeed,  the  probability  that  the  random  n-voctor  lies  within  its 
boundaries  is  pn(l)  as  given  by  Equation  (30)  or  (31).  not  PjU)  (68%)  as  is 
often  incorrectly  assumed.  Specifically,  P](l)  i.  the  probability  that  any 
one  element  of  the  random  vector  lies  between  the  intercepts  of  the  hyper- 
ellipsoid  with  the  corresponding  coordinate  axis  without  regard  to  where  the 
remaining  element,  lie.  In  short,  for  n  >  1,  pn<l)  assumes  simultaneity, 

while  Pl(l)  does  not!  Indeed,  pn(l)  is  always  smaller  than  p.(l)  (See 
Figure  1).  1 


Another  common  misconception  is  that  the  square  roots  of  the 
diagonal  elements  of  the  covariance  matrix  represent  the  lengths  of  the 
semi  -axes  of  the  one-sigma  error  hyperellipsoid.  Actually,  they  bear 
no  direct  relationship  to  this  contour.  Note  that  the  intercepts  of  the 
one  -sigma  hyperellipsoid  with  the  coordinate  axes  are  given  by  the 
reciprocal  square  roots  of  the  diagonal  elements  of  the  inverse  of  the 
covariance  matrix  as  can  be  shown  by  examination  of  Equation  (3). 

These  quantities,  however,  only  provide  the  coordinate  intercepts 
of  the  one-sigma  hyperellipsoid  and  dp  not,  in  general,  define  the 
semi-axes  of  the  hyperellipsoid.  The  distinction  between  these 
disappears  only  when  the  coordinate  axes  and  principal  axes  coincide. 
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Since  the  probability  level  corresponding  to  a  one-sigma  hyper- 

ellipsoid  in  n-space  varies  with  n  and  is  small  for  large  n,  it  is  generally 

more  desirable  to  consider  hyperellipsoids  related  to  a  specific  probability 

confidence  level  (such  as  50%).  The  analog  of  the  covariance  matrix  for  such 

2  f 

a  region  can  be  found  by  multiplying  the  covariance  matrix  by  the  k  cor¬ 
responding  to  any  given  pfi(k).  The  resulting  matrix  can  be  conveniently 
named  the  "k-variance  matrix"  and  the  associated  error  contour  called  the 
"k-sigma  hyperellipsoid.  "  As  with  the  covariance  matrix,  the  square  roots 
of  the  reciprocals  of  the  diagonal  elements  of  the  inverse  of  the  k-variance 
matrix  represent  the  intercepts  of  this  hyperellipsoid  with  the  coordinate 
axes. 

It  is  evident  in  many  cases  that  the  diagonal  elements  of  the  inverse 
of  the  covariance  (or  k-variance)  matrix  will  not  adequately  describe  the  prob¬ 
ability  distribution  of  a  given  random  vector.  Now,  in  general,  a  hyper - 
ellipsoid  in  n-space  is  not  very  useful  since  it  cannot  be  readily  visualized.  In 
addition,  the  enclosed  region  is  meaningless  if  the  various  components  of  the 
random  vector  do  not  represent  the  same  physical  quantities  (i.  e.  ,  if  they 
are  not  measured  in  commensurate  units). 


This  is  algebraically  equivalent  to  diagonalizing  the  covariance  matrix, 
multiplying  the  resultant  by  k  ,  and  rotating  back  to  the  initial  coordinates. 
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In  such  situations,  insight  can  be  gleaned  by  projection  into  lower 
dimensional  subspaces,  usually  2- or  3-space,  in  which  each  of  the  components 
can  be  expressed  in  the  same  units.  Two  possibilities  are  available:  (1)2- 
or  3 -dimensional  projections  of  a  general  n-dimensional  hyperellipsoid  which 
constrains  all  random  variables  can  be  considered;  (2)  k-sigma  ellipses 
or  ellipsoids  can  be  found  for  compatible  2  or  3  element  sets  of  the  random 
vector  without  regard  to  the  behavior  of  the  remaining  elements.  In  the 
former  case,  the  desired  contour  is  established  by  extracting  the  proper  parti¬ 
tion  of  the  inverse  of  the  k-variance  matrix.  In  the  latter  case  the  desired 

ellipse  or  ellipsoid  can  be  obtained  by  partitioning  the  covariance  matrix 

2 

first,  multiplying  the  result  by  the  appropriate  k  for  p2(k)  or  p,j(k)  and 
then  performing  a  matrix  inverse.  In  either  case,  the  magnitudes  and  direc¬ 
tions  of  the  principal  axes  of  the  final  contours  can  be  found  by  solving  the 
related  eigenvalue -eigenvector  problem. 

Instead  of  considering  the  geometrical  problems  of  displaying  hyper - 
ellipsoid  error  regions,  a  possible  alternative  is  to  present  results  in  terms  of 
hyperspheres  with  the  same  probability  level.  Although  this  approach  may 
seem  appealing  at  first,  it  has  accompanying  disadvantages.  Unless  the 
principal  axes  of  the  given  hyperellipsoid  are  nearly  equal,  use  of  the  corre¬ 
sponding  hypersphere  can  lead  to  serious  errors  in  engineering  judgement 
because  all  information  regarding  preferred  directions  will  be  lost.  Further¬ 
more,  even  when  the  use  of  hyperspheres  is  justifiable,  the  desired  radius  is 
not  easily  determined.  For  n  =  2  and  n-3  special  algorithms  exist  for  this  com¬ 
putation  [References  2,  4].  In  these  cases,  when  pn(k)  -  .50,  the  results  are 
the  well-known  Circular  Error  Probability  (CEP)  and  Spherical  Error  Probability 
(SEP),  respectively. 


In  order  to  illustrate  the  above  concepts,  consider  the  various 

50%  probability  contours  in  the  x.  -  x?  plane  associated  with  a  zero 

1  ^  * 

mean  Gaussian  random  vector  x  =  (x^,  X£.  x^ )  whose  covariance 
matrix  is 


P  = 


1 

0.  95 
0.  90 


0.  95 
1 

0.  95 


0.  90 
0.  95 
1 


(32) 


First  establish  the  x^  -  x^  projection  of  the  3 -dimens ional 
ellipsoid  which  encloses  50%  of  the  values  of  Xj.  As  indicated  above, 
the  appropriate  partition  of  the  inverse  of  the  k-variance  matrix  must 
be  found.  For  the  case  at  hand,  n  =  3,  p^(k)  =  0.  50,  so  that  Table  1 
yields  k  =  I.  5382.  Thus 


"  4. 338 

•4.  226 

.  1122' 

2  "  1 

Ik  P ) 

-4.  226 

8.453 

-4. 226 

(33) 

.  .1122 

-4.  226 

4.  338  . 

and  the  desired  contour  is  given  by  the  equation 


[xl-  x2] 


338 

226 


-4.  226 
8.  453. 


=  1 


(34) 


Equation  (34)  implicitly  carries  a  constraint  on  x^.  A  50% 

contour  in  the  Xj  -  x^  plane  which  ignores  the  value  of  x^  can  also  be 

established.  To  accomplish  this,  first  partition  the  P-matrix,  then 
2 

multiply  by  the  k  satisfying  P^k)  0.  50  (where  from  Table  1, 
k  -  1.  1774)  and  finally  invert  the  result 
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1 


"1  0.  95' 

’xr 

(1.  1774)2 

.0.  95  1 

-x2- 

(35) 


or 

[xi*  **] 


’  7.399  -7.029" 

X1 

-7.02  9  7.  3 99_ 

x2. 

(36) 


Observe  that  the  reciprocal  square  roots  of  the  diagonal 
elements  of  the  matrices  in  (34)  and  (36)  give  the  coordinate  axes  inter¬ 
cepts  of  the  respective  ellipses,  while  the  solutions  to  the  corresponding 
eigenvalue -eigenvector  problem  yields  the  principal  axes  and  orientation 
angles.  Note  also  that  the  square  roots  of  the  diagonal  elements  of  the 
P-matrix  are  the  standard  deviations  of  the  individual  elements  Xj,  x^» 
and  Xy  Multiplying  each  by  k  =  0.  67449  (obtained  from  Table  1  for 
Pj(k)  =  0.50)  gives  the  50%  boundaries  on  each  element  of  x  without  regard 
to  the  behavior  of  the  remaining  two  elements. 

The  various  contours  and  boundaries  disci:  i  d  above  are 
illustrated  in  Figure  2.  For  completeness  the  CEP  i  *  !i  •  protection 
of  the  SEP  are  also  shown  on  the  diagram.  The  exampd  -ie  "i» 
considerable  variation  possible  for  different  contours  a  ~  i<  <i. 

the  same  covariance  matrix.  The  analyst,  therefore,  must  carefully 
consider  the  alternatives  and  their  interpretations  hep. re  >  .nc  a 
choice.  While  in  general,  there  is  no  "best "  geonr-l  r u  : .  rp reta lion 
of  a  Gauasian  probability  distribution, error  ellipses  and  ellipsoids  are 
usually  preferable  since  they  contain  more  information  than  the  other  forms. 
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